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6.  Abstract 

Continuing  medical  education  (CME)  serves  to  maintain  or  increase  the  knowledge, 
interpretive  proficiencies,  and  technical  skills  that  a  physician  uses  in  his/her 
practice  of  medicine.  Resulting  Improvement  in  professional  performance  is  fre¬ 
quently  difficult  to  measure,  particularly  in  aerospace  medicine,  but  CME  is 
required  for  relicensure  and/or  for  medical  society  membership  in  70X  of  states. 

The  Civil  Aeromedical  Institute  first  received  American  Medical  Association  approval 
for  Category  I  CME  credit  for  attendance  at  FAA  seminars  in  January  1973.  We  began 
preparing  21-item  annual  performance  reports  for  each  aviation  medical  examiner  (AME3 
in  1979  to  attempt  to  isolate  the  causes  of,  and  to  reduce,  computer  rejection  of 
about  one-fourth  of  all  medical  certification  input  because  of  omissions  or  proce¬ 
dural  errors.  There  was  little  improvement  in  error  rate  through  1982.  We  are 
presently  conducting  special  sessions  and  open-book  tests  for  new  AME's,  lecturing 
to  military  flight  surgeons,  and  encouraging  Regional  Flight  Surgeons  to  review 
reports  of  physical  examinations  from  new  and  frequent-error  AME's.^vWe  conducted 
a  special  analysis  of  1983  AME  performance  data  to  determine  the  relationships 
between  errors  and  omissions  and  number  of  exams  performed,  recency  land  frequency 
of  seminar  attendance,  and  pilot  or  military  flight  surgeon  experience.  Errors  were 
significantly  reduced  with  recent  and  frequent  seminar  attendance,  larger  volume  of 
exams,  and  pilot  and  military  flight  surgeon  experience.  I 
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EFFORTS  TO  IMPROVE  AVIATION  MEDICAL  EXAMINER  PERFORMANCE 
THROUGH  CONTINUING  MEDICAL  EDUCATION 
AND  ANNUAL  PERFORMANCE  REPORTS 

INTRODUCTION 

Louis  H.  Bauer,  M.D. ,  the  first  Medical  Director  in  the  Aeronautics 
Branch,  U.S.  Department  of  Commerce,  conducted  12  training  conferences 
for  aviation  medical  examiners  (AME's)  in  1929  and  1930.  No  further  courses 
were  held  until  the  present  seminar  program  was  begun  In  December  1960. 

To  date,  279  3-day  and  5-day  seminars  have  been  held  with  a  total  attendance 
of  about  31,500. 


The  Federal  Aviation  Administration  (FAA)  AME  seminars  conducted  by 
the  Civil  Aeromedical  Institute  were  first  approved  by  the  American  Medi¬ 
cal  Association  for  Category  I  continuing  medical  education  (CME)  credit 
In  January  1973  and  are  currently  approved  until  1988.  The  American 
Academy  of  Family  Physicians  and  the  American  Osteopathic  Association 
also  regularly  grant  CME  credit  for  attendance. 

CME  Is  composed  of  any  education  or  training  that  serves  to  maintain, 
develop,  or  Increase  the  knowledge,  interpretive  and  reasoning  proficiencies, 
applicable  technical  skills, professional  performance  standards,  or  ability 
for  Interpersonal  relationships  that  a  physician  uses  to  provide  the  ser¬ 
vices  needed  by  patients  or  the  public.  The  end  result  is  usually  improved 
patient  care  outcome.  While  701  of  states  require  CME  for  reregistration 
of  a  license  to  practice  medicine  and/or  for  continuing  membership  in 
state  medical  societies,  studies  rarely  document  any  demonstrated  improve¬ 
ment  in  patient  outcomes. 

We  have  long  been  concerned  about  but  usually  unaware  of  the  thorough¬ 
ness  of  airman  physical  examinations  by  individual  AME's.  Those  found 
to  be  performing  cursory  exams  are  usually  not  reappointed  for  the  next 
year,  but  evidence  is  difficult  to  obtain.  Detectable  but  unreported 
significant  physical  defects  are  rarely  found  in  pilots  killed  In  aircraft 
accidents.  Also,  certificates  are  rarely  issued  to  airmen  obviously  not 
qualified. 


Tear  after  year,  50%-52%  of  applications  for  airman  medical  certifi¬ 
cates  entered  In  the  computer  are  rejected  for  omission  of  information, 
failure  to  meet  the  physical  standards,  or  significant  changes  since  the 
last  exams.  About  half  of  these  are  administrative  errors,  which  include 
omissions  and  procedural  errors. 


We  have  used  Federal  Air  Surgeon  newsletter  articles  and  seminar 
lectures  for  several  years  to  attempt  to  reduce  these  costly  mistakes, 
but  to  no  avail.  In  1979,  we  began  preparing  and  sending  to  each  AME 
a  report  of  the  frequency  and  percentage  of  his/her  errors  in  21  cate¬ 
gories.  These  are  reviewed  by  Regional  Flight  Surgeons,  and  AME's  with 
poor  records  are,  we  hope,  contacted  or  even  dropped.  Again,  there  was 
no  observed  benefit.  In  fact,  the  error  rate  for  military  flight  surgeons 
(who  usually  attend  no  seminars)  increased  from  35.3%  in  1981  to  shout 
41%  in  1982  and  1983  despite  lectures  at  Army  and  Air  Force  operational 
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The  1983  consolidated  performance  sunnary  report  for  active  duty  mili¬ 
tary,  Reserve,  and  National  Guard  flight  surgeon  units  is  shown  in  Table  I. 
The  error  rate  is  calculated  by  dividing  the  number  of  errors  and  omissions 
that  cause  the  computer  to  reject  an  application  by  the  number  of  reports 
of  exams  received.  Granted,  some  reports  may  contain  multiple  errors  and 
others  none,  so  that  the  true  rate  of  rejected  documents  is  not  obtained. 
However,  the  data  are  valid  for  making  .comparisons  and  for  determining 
trends  and  the  incidence  of  errors  serious  enough  to  result  in  rejection 
of  the  application  by  the  computer.  Few  military  flight  surgeons  are 
contacted  regarding  individual  applications  with  errors  and  omissions 
because  of  our  Insufficient  staff  and  assisted  good  health  of  active  mili¬ 
tary  pilots;  many  say  they  have  never  seen  a  performance  report. 


TABLE  I.  PERFORMANCE  SUMMARY  REPORT:  MILITARY  FLIGHT  SURGEONS,  1983. 


Total  exams  performed:  47,756 


Errors  Identified 


Frequency 


Total  Exam 
Rate  (Z) 


A  -  Computer-issued  corrected  certificate 
B  -  Corrected  certificate  issued  by  certifica¬ 
tion  personnel 

D  -  Intraocular  tension,  item  52,  blank 
E  -  Field  of  vision,  item  54,  blank 
F  -  Color  vision,  item  53,  blank 
G  -  All  or  part  of  medical  history,  item  21, 
blank 

H  -  Abnormalities,  items  25-48,  blank 
I  -  AME  not  authorized  first  class 
J  -  Distant  vision,  item  50,  blank 
K  -  Near  vision  blank 

L  -  Distant  or  near  vision  exceeds  standards — 
certificate  issued — no  waiver  held 
M  -  Class  of  certificate  issued  higher  than 
applied  for 

N  -  Student /medical  combination  issued  to  airman 
less  than  16  years  of  age 
0  -  Blood  pressure,  item  56,  exceeds  standards 
or  omitted — certificate  issued 
P  -  Pulse,  item  57,  exceeds  standards  or  omitted — 
certificate  issued 

Q  -  Certificate  issued  of  higher  class  than 
waiver  issued  class 
R  -  Medication  field,  item  15,  blank 
S  -  Hearing  field,  item  49,  blank  and  no  audio- 
gram  given 

T  -  Urinalysis  field,  item  58,  blank 
V  -  AME  error  letter  sent  to  AME 
W  -  Certificate  issued  to  airman  obviously  not 
qualified 


1,408 


190 

4,491 

483 

495 


1,777 

163 

191 

654 

816 


1,787 
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1,291 
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Recently,  we  added  a  special  Thursday  evening  session  (before  the 
3- day  Friday-Sunday  seminars)  with  a  discussion  of  adninistrative  proce¬ 
dures  and  an  open-book  test  for  newly  designated  physicians.  We  now  give 
certification  update  lectures  to  all  AME's  at  seminars  rather  than  offer 
optional  certification  clinics.  One  Regional  Flight  Surgeon  has  new  and 
hlgh-error  AKE's  send  10  reports  of  physical  exams  to  his  office  for  grad¬ 
ing.  International  AME's  oust  now  attend  a  seminar  before  designation. 
Consideration  has  been  given  to  all  AME's  attending  before  appointment 
rather  than  within  1  year  after  and  every  5  years  thereafter,  as  presently 
required.  Suggestions  have  been  made  that  military  personnel  also  be 
required  to  attend  seminars.  Revision  of  the  application,  history,  and 
physical  examination  form  (FAA  Form  8500-8)  to  Improve  clarity  has  been 
discussed. 

METHODS 

In  order  to  obtain  information  about  the  value  of  (1)  repeated  semi¬ 
nar  attendance,  (11)  an  AME: airman  ratio  of  about  1:100  for  economy  and 
for  maintaining  familiarity  with  procedures,*  (111)  experience  as  a  mili¬ 
tary  flight  surgeon  (19%  have),  and  (lv)  pilot  status  (about  48%  are), 
we  analyzed  the  1983  certification  data  for  omission  and  certification 
error  frequencies  and  rates  for  these  status  variables.  We  also  examined 
errors  for  the  past  year  to  see  if  any  early  effects  were  evident  from 
the  Thursday  evening  sessions,  certification  lecture  instead  of  clinic, 
or  review  of  reports  by  one  Regional  Flight  Surgeon. 

Error  codes  D,  E,  F,  G,  H,  J,  K,  R,  S,  and  T  are  considered  to  be 
omissions  and  primarily  clerical  errors.  Error  codes  A,  B,  I,  L,  M,  N, 

0*  P,  Q,  V,  and  W  are  considered  certification  errors. 

RESULTS  AND  DISCUSSION 

The  annual  AME  status  vs.  error  report  shows  significant  (at  0.05 
by  the  critical  ratio  rate  test)  reduction  in  omitted  items  and  certifi¬ 
cation  errors  with  (1)  seminar  attendance  the  previous  year  and,  with  one 
exception,  (li)  more  seminars  attended  (Fig.  1),  (iii)  increased  volume 
of  exams  per  year  (Fig.  2),  (iv)  pilot  experience,  and  (v)  military  flight 
surgeon  experience  (Fig.  3). 

We  did  not  determine  if  recency  of  exposure  or  program  content  was 
responsible  for  the  Improved  performance  with  seminar  attendance  within 
the  past  year.  Error  rates,  by  Region,  are  not  included  in  this  report 
as  originally  planned  but  will  be  addressed  in  an  analysis  of  errors  and 
omissions  for  1984. 

CONCLUSIONS 

Despite  the  high  computer  reject  rate,  it  appears  that  the  AME  desig¬ 
nation  and  training  policies  and  practices  are  valid  and  should  be  continued. 


*Tha  present  AME: active-airman  ratio  varies  from  1:50  to  1:150  among  the 
nlAa  Regions  with  an  overall  ratio  of  1:86. 


Increased  attention  needs  to  be  given  to  decreasing  the  ratio  of  AME's 
to  active  airmen  in  some  Regions  for  improved  economy  and  performance, 
requiring  attendance  at  a  seminar  before  appointment.  Regional  medical 
officers  reviewing  the  reports  of  physical  examinations  performed  by  new 
and  high-error  AME's,  training  AME  office  assistants  in  metropolitan  areas, 
providing  better  orientation  (and  perhaps  required  training)  for  military 
flight  surgeon  unit  personnel,  and  getting  poor  performance  susnary  reports 
past  NCOIC's  and  actually  into  the  hands  of  military  flight  surgeons. 
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Fig.  I.  Effects  of  the  number  of  aviation  medical  examiner 
seminars  attended  and  recency  of  attendance  on 
the  rates  of  certification  errors  and  omission  of 

information. 
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Fig.  2. 


NO.  OF  EXAMS  PER  YEAR 


Effects  of  the  number  of  airman  physical  examinations 
performed  each  year  on  error  rates. 
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Pilot  Former  Milit.  F/S  Pilot  Former  Milit.  F/S 

Fig.  3.  Effects  of  pilot  and  military  flight  surgeon  experience 
on  error  rates. 

Significant  at  0.05  by  critical  ratio  rate  test. 
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